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Abstract 

Low density parity check (LDPC) codes with iterative decoding based on belief prop- 
agation achieve astonishing error performance close to Shannon limit. No algebraic or 
geometric method for constructing these codes has been reported and they are largely gen- 
erated by computer search. As a result, encoding of long LDPC codes is in general very 
complex. This paper presents two classes of high rate LDPC codes whose constructions are 
based on finite Euclidean and projective geometries, respectively. These classes of codes 
are cyclic and have good constraint parameters and minim um distances. Cyclic struc- 
ture allows the use of linear feedback shift registers for encoding. These finite geometry 
LDPC codes achieve very good error performance with either soft-decision iterative decod- 
ing based on belief propagation or Gallager’s hard-decision bit flipping algorithm. These 
codes can be punctured or extended to obtain other good LDPC codes. A generalization 
of these codes is also presented. 
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1. Introduction 


LDPC codes were first discovered by Gallager ( 1 , 2 ] in early sixties and have recently been redis- 
covered and generalized (3-11). These codes with iterative decoding based on belief propagation 
achieve astonishing error performance close to Shannon limit (4,7,8). A LDPC code is defined 
by a parity check matrix H with the following structural properties: ( 1 ) each row consists of 
p “ones”; (2) each column consists of 7 "ones"; (3) the number of "ones” in common between 
any two columns, denoted A , is no greater than 1; and (4) both p and 7 ^re small compared 
to the length of the code. The code is simply the null space of H. Since p and 7 are small, 
H has a small density of “ones”. For this reason, the code specified by H is called a LDPC 
code. Although LDPC codes have been shown to achieve outstanding error performance, no 
analytic (algebraic or geometric) method has been found for constructing these codes. Codes 
that have been found are largely computer generated, especially long codes. Encoding of these 
long computer generated codes is very complex. 

In this paper, we present two classes of high rate LDPC codes whose constructions are based 
on two-dimensional finite Euclidean and projective geometries, respectively. The parity check 
matrix H is a square matrix whose columns correspond to the points of a geometry. Each row 
of the matrix is the incidence vector of a line in the geometry. The number of “ones” in each 
row is equal to the number of points on a line. The number of “ones” in each column of H 
is equal to the number of lines that intersect at the point corresponding to the location of the 
column. Any two columns have exact one “1” in common, i.e., A =1. This ensures that there 
is no cycle of length 4 in the graph (called Tanner graph (3]) that represents the code. This 
last structural property is very important for a LDPC to achieve good error performance with 
interative decoding based on belief propagation. 

These two class of codes are small but infinite. Long LDPC codes can be constructed 
algebraically and easily. Codes in these two classes are cyclic and therefore, their encoding 
can be achieved with linear shift registers with feedback connections based on their generator 
polynomials. 

A LDPC code constructed based on finite geometry can be punctured by removing the 
columns of the parity-check matrix that correspond to the points of a set of lines. This punctua- 
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tion results in a shortened LDPC code with at least the same minimum distance as the original 
code. A finite geometry LDPC code can also be extended by splitting each column of its parity 
check matrix into multiple columns. This column splitting results in a new parity check matrix 
with lower density of “ones”. Finite geometry LDPC codes, their shortened and extended codes 
achieve both good bit and word error performances with either soft-decision iterative decoding 
based on belief propagation or Gallager’s hard-decision bit flipping algorithm. 

Also presented in this paper are a generalization of the code construction based on multi- 
dimensional finite geometries and a connection between LDPC codes and balanced incomplete 
block designs. 

2. LDPC Codes Constructed Based on Two-dimensional Euclidean Geometry 
EG(2, 2 s ) 

Consider the Galois field GF(2 2 *) which is regarded as an extension field of GF(2*). Let a be 
a primitive element of GF(2 2 '). Then the powers of a,a oo = 0,a° = l,a l , a 2 , ..., a 24-2 , form all 
the elements of GF(2 2< ). Each element a 1 can be expressed in polynomial form, 

O* = £>i,0 + bi t \Q 

and uniquely represented by a two-tuple (6,,oA,i) with 6, <0 and b iti in GF(2'). Each two-tuple 
(bi,o,bi,i) over GF(2') forms a point in the two-dimensional Euclidean geometry over GF(2'), de- 
noted EG(2,2'), [12-14]. Therefore, Galois field GF(2 24 ) may be regarded as the two-dimensional 
Euclidean geometry EG(2,2') over GF(2*). The elements of GF(2 2 *) form all the points of 
EG(2, 2*). The zero two-tuple, (0,0), (or the zero element 0 =q°° of GF(2 2 ')) is called the origin 
of EG(2,2'). 

EG(2, 2*) consists of points and lines. Let p 0 and pi be two linearly independent points in 
EG(2,2 4 ). Then the collection of following 2* points, 

{Po + /?Pi} (2.1) 

with /? in GF(2*), constitutes a line in EG(2,2') that passes through the point p 0 . Of course, 
this line also passes through other 2* - 1 points. Let p 2 be a point which is linearly independent 
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of pi and also linearly independent of po- Then the lines, {po + /?Pi) and {po + /?Pa} have one 
and only one point, po, in common. We say that these two lines intersect at the point po- Two 
lines with two common points are identical. Given a point p 0 in EG(2,2*), there are 

T = 2 ‘ + 1 (22) 

lines in EG(2, 2*) that intersect at p 0 , including the line {/?p 0 } that passes through the origin. 

Two lines are said to be parallel if they have no common points. Each line in EG(2,2*) has 
2* — 1 other lines parallel to it. No two lines can have more than one point in common. The 
total number of distinct lines in EG(2,2‘) is 

2'(2* + l). (2.3) 

Let v = (u 0 ,t>i, ...,v 2 »«->) be a (2 2j - l)-tuple over the binary field GF(2). Number the 
components of v with the nonzero elements of GF(2 2 ') (or the non origin points in EG(2,2')) as 
follows: the component v* is numbered a’ for 0 < t < 2 2 * — 2. Hence, a' is the location number 
of Vj. Let £ be a line in EG(2,2*) that does not pass through the origin (0,0) (or a 00 ). Based 
on £, form a binary (2 2 * — l)-tuple as follows: 

v £ = (uo»vi,...,v 2 »._ 2 ) 

whose t-th component u, is 1 if its location number a ‘ is a point on £; otherwise, v, is 0. That 
is, the location numbers for the nonzero components of Vc form the points of £. This vector vc 
is called the incidence vector of line £. 

Form a (2 2t - 1) x (2 2 * - 1) matrix H whose rows are the incidence vectors of the 2*(2* + 1) — 
(2* + 1) = 2 24 - 1 lines in EG(2,2*) that do not pass the origin. It follows from the structural 
properties of lines in EG(2,2*) that matrix H has the following structures: (1) Each row has 
p = 2* “ones”; (2) Each column corresponds to a non origin point in EG(2,2*) and has y = 2* 
“ones”; and (3) Any two columns have one and only one “1” in common, i.e., A = 1. The ratio 
of the total number of “ones” to the total number of entries in H matrix, called the density 
of H, is r = 2 */(2 2 * - 1). For large s, this density is very small. Therefore, H has a very low 
density of “ones”. Actually, the H matrix can be constructed easily by taking the incidence 
vector vc for a line £ in EG(2,2*) which does not pass through the origin and then cyclically 
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shifting this incidence vector \c 2 7 * - 2 times. This results in 2 7 * — 1 incidence vectors for 
2 7t - 1 distinct lines in EG(2,2') that do not pass the origin. The incidence vector \ c and its 
2 2# - 2 cyclic shifts form the rows of H matrix. 

As an example, consider the Galois field GF(2 2xJ ) generated by the primitive polynomial 
p{X) = 1 + X + X 4 which is given in Table 1. Regard this field as the two-dimensional Euclidean 
geometry EG(2,2 2 ) over GF(2 2 ). Let a be a primitive element of GF(2 2xJ ) and 0 = a 5 . Then 
{0, l, 0 , 0 7 } form the subfield GF(2 2 ). Every line in EG(2,2 2 ) consists of 4 points. The set of 
4 points {a 14 + 77a} with r? €GF(2 2 ) is {a 7 , a 8 , a 10 , a 14 } which forms a line in EG(2,2 2 ). The 
incidence vector for this line is (0 0 0 0 0 0 0 1 1 0 1 0 0 0 1). This vector and its 14 cyclic shifts 
form the matrix H as shown in Figure 1. 

Let C be the null space of H. Then C is a LDPC code of length n = 2 2 ' - 1. It turns 
out that C is the (0, s)-th order EG (Euclidean Geometry) code and is cyclic [ 14 ], It is also 
a type-1 DTI (doubly transitive invariant) code discovered by Lin and Markowshy [ 16 ]. The 
generator polynomial of this code is completely characterized by its roots in GF(2 2 *). Let h be 
a nonnegative integer less than 2 2 '. Then h can be expressed in radix- 2 * form as follows: 

h — 6 0 + < 5 i 2 * 

where 0 < < 5 , < 2* for i=0 and 1. The 2 *-weight of h, denoted W 2 .(h), is defined as the following 
sum, 


W 2 i(h) — (5o -I- <Si. (2.4) 

Let h ^ be the remainder resulting from dividing 2 l h by 2 2 * — 1, i.e., 

2'ft = ,(2*' - 1) + AW (2.5) 

with 0 < A (,) < 2 2t - 1. Let g(X) be the generator polynomial of C. Then a n is a root of g(X) 
if and only if [ 14 ] 

0 < ik/o ^ ( 2 * ~ J )- (2.6) 

The number of roots can be enumerated and is equal to 3 * - 1. C has the following parameters: 
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Length n = 2 J * - 1, 

Number of parity bits n - k = 3* — 1, 

Dimension k = 2 J * - 3*, 

Minimum distance d m i n = 2* + 1. 

Example 1 : Let s = 7 . The LDPC code constructed based on EG( 2 , 2 7 ) is a (16383, 14197) 
code with d min = 129. The rate of this code is R = 0.867. Its parity-check matrix H has the 
following parameters: p = 7 = 128 and A = 1. The density of H is r = 2'/(2 J * - 1) = 0.007813. 
The error performance of this code with various decoding algorithms is shown in Figure 5. A A 
The third property of a low density parity check matrix H, A = 1 , ensures that there is no 
rectangle in H with four "ones” at its four corners. This implies that the Tanner graph [3] for 
the code generated by H has no cycle of length 4, i.e., no two code bits are checked by the same 
two parity constraints (or parity check sums as Massey called them [15]). 

It follows from the structural properties of matrix H that for any bit position a' with 
0 < i < 2 24 — 1 , there are exact 7 = 2 * rows in H which have the following properties: ( 1 ) Each 
row has a “one" at position a'; and ( 2 ) For j ^ i, there is at most one row with a “one” at 
position cP . In Messay’s terminology, these 2 4 rows are said to be orthogonal on the bit position 
o'. Parity-check sums formed by these orthogonal vectors can be used to estimate the code 
bit Vi based on majority-logic rule in one step [14,15]. Therefore, the LDPC code generated by 
matrix H is one-step majority-logic decodable and is capable of correcting 2 ,_1 errors. 

A list of EG-LDPC codes with their important parameters is given in Table 2 . 

3. LDPC Codes Constructed Based on Projective Geometry PG(2, 2 5 ) 

Construction of LDPC codes based on a projective geometry is very similar to that based on 
an Euclidean geometry. In this section, we consider construction of LDPC codes based on the 
two-dimensional projective geometry PG( 2 , 2 ') over GF( 2 4 ). 

Consider the Galois field GF( 2 3 *) which is regarded as an extension field of GF( 2 4 ). Let a 
be a primitive element of GF( 2 3 *). Let 

n = 7j7£j = 22 ' + 2 ' + 1 - (3.1) 
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Then the order of p = a n is 2’ - 1. The elements 0, 1, /?,/?*, ...,0 2 '- 2 form all the elements of 

« 

the subfield GF(2*). Consider the set 


T = {a 0 , a 1 , a 2 ,..., a" ’}. (3.2) 

Partition the nonzero elements of GF(2 5 ') into n disjoint subsets as follows: 

{a\pQ l ,p 2 a\...,0 i4 ~ i Q i }, 

{q 2 ,^ 2 ,^ 2 ,...,/? 2 '-^ 2 }, (3.3) 


{a n -\pa n -\p 7 a n ~\. . . ,p v ~ i a n ~ 1 }. 

We readily see that no element in one set can be a product of an element of GF(2‘) and an 
element from a different set. Represent each set by its first element as follows: 

(o') = {o'./Jo'.jSV (3 4) 

with 0 < i < n. For any a j in GF(2 3 '), if ct> = fi'a' with 0 < i < n, then a j is represented by 
(a 1 ). The n elements 

(a 0 ), (a 1 ), (a 2 ),..., (a"" 1 ) (3.5) 

form the points of the two-dimensional projective geometry PG(2,2*) over GF(2 < ) [12,14]. Note 
that all the 2* — 1 elements in (a 1 ) are regarded as the same point in PG(2, 2*). 

Let (a*) and (a*) be any two distinct points in PG(2,2*). Then the line C passing through 
(a*) and (o^) consists of points of the following form: 


(ziq‘ + z 2 oc j ) 


(3-6) 


where z x and z 2 are elements from GF(2‘) and are not both equal to zero. Since (z x a* + z 2 a ? ) 
and (P l z x a* + P l z 2 oP) are the same point, the line C consists of 


( 2‘) 2 ~ 1 

2 * - 1 


= 2 * + 1 


(3-7) 


points. Let (a*) be a point not on the line { z x a ' + z 2 oc>}. Then the line {z x a' + z 2 a>} and the 
line {z x a* + z 2 c ir*} have (a J ) as a common point (the only common point). We say that these 
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two lines intersect at the point (o^). The number of lines in PG(2,2*) that intersect at a given 
point (a 3 ) is 

= V + 1. (3 8) 

2 * - 1 

There are 2 24 + 2* + 1 distinct lines in PG(2,2 4 ) (12-14). 

Let V = (v 0 ,vi, .... v n _i) be an n-tuple over GF(2). Number the components of v with the 
elements in T (or the points in PG(2,2')) as follows: t>j is numbered a* for 0 < i < n. Let £ be 
a line in PG(2, 2'). Define the incidence vector for £ as follows: 


where 


Vj = 


1, if (o’) is a point on £ 
0, otherwise. 


Form a (2 24 + 2* + 1) x (2 24 + 2* + 1) matrix H whose rows are the incidence vectors of 
the 2 2 * + 2' + 1 lines in PG(2,2 4 ). This matrix H has the following structural properties: (1) 
Each row has p = 2* + 1 "ones”; (2) Each column corresponds to a point in PG(2,2‘) and has 
7 = 2* + 1 “ones”; and (3) Any two columns have exact one “1" in common, i.e., A = 1. The 
density of this matrix is r = (2 4 + l)/(2 2 ‘ + 2' + 1). Again H can be obtained by cyclically 
shifting an incident vector 2 2 * + 2 4 times. Let C be the null space of H. Then C is a LDPC 
code of length n = 2 Ji + V + 1. This code turns out to be the (l,s)-th order PG (projective 
geometry) code (14) and also is a difference-set code (14, 17). It is cyclic. Let h be a nonnegative 
integer less than 2 3< - 1. The generator polynomial g(X) of C has a* as a root if and only if h 


is divisible by 2* — 1 and 


0 < ma)t W 2 »{h^) = j( 2* — 1) (3.9) 

with 0 < j < 1 (14). The number of roots in g(X) is 3* + 1. C has the following parameters: 

Length n — 2 2i + 2* + 1, 

Number of parity bits n — k = 3 J + 1, 

Dimension k = 2 2 * + 2* - 3*, 

Minimum distance dmin = 2* + 2. 
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Example 2: Let a - 6. The LDPC code constructed based on the lines of PG(2,2 6 ) is a 
(4161,3431) code with minimum distance d min = 66 and rate R = 0.82456. The parity check 
matrix H has the following parameters: p = 65,7 = 65, A = 1 and density r = 0.0156. The 

error performance of this code with iterative decoding based on belief propagation is depicted 
in Figure 4. 

Again Tanner graphs for LDPC codes constructed based on the lines of PG(2,2*) do not 
have cycles of length 4 and the codes are also one-step majority-logic decodable. 

A list of PG-LDPC codes with their important parameters is given in Table 3. 

4. Puncturing and Extension 

Finite geometry codes can be punctured in various ways to obtain good shortened LDPC codes. 
Consider an EG-LDPC code C generated by a low density parity check matrix H whose columns 
correspond to the 2^ - 1 non origin points in EG(2,2‘). Let £ be a line in EG(2,2*) that does 
not pass through the origin of EG(2,2'). Then the incidence vector v £ of £ is a row in H. 
Remove the columns of H that correspond to the 2* points on £. This results in a matrix H' 
with 2 2 ' - 2 * - 1 columns. The row in H that is the incidence vector v £ of £ becomes a zero row 
in H'. Removing this zero row from H', we obtain a (2 2 ' - 2) x (2 2 ' - 2* - 1) matrix H,. Each 
column of H, still has 7 = 2' “ones” as the original matrix H. Removing a column of H that 
corresponds to a point a* on £ will delete a “one” from 2* - 1 rows in H which are the incidence 
vectors of the lines that intersect with line £ at the point a*. Therefore, there are 2 ‘( 2 * - 1) 
rows in H, with weight p, = V - 1. There are V - 2 lines not passing through the origin of 
EG(2,2 J ) that are parallel to £. Deleting the columns of H that correspond to the points on 
£ does not change the weights of the rows which are the incidence vectors of the 2 ‘ — 2 lines 
parallel to £. Therefore, there are 2' - 2 rows in H, with weight pj = 2*. Any two columns 
in H, still have exactly one “1" in common, i.e., A = 1. The density of H, is r = 2 ‘ /(2 2 ' - 2). 
Therefore H, is still a low density matrix. 

Let C, be the null space of H,. Then C, is a LDPC code of length n = 2 2 ' - 2 * - 1. 
Clearly, C, is obtained from C by deleting the components of each codeword at the positions 
that correspond to the points on the line £. Since the rows of H, do not have the same weight, 
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C, is an irregular LDPC code. However, all the columns of H, have the same weight which 
is still 7 = 2V Therefore, we still can form V parity-check sums orthogonal on any code 
bit. Consequently the majority-logic correcting capability is still 2 ,_l and hence its minimum 

distance is at least 2* + 1 [14,15]. 

Example 3: Let s = 4. The EG-LDPC code with s = 4 is a (255, 175) code (the third code in 
Table 2) with rate R = 0.6863, <L in = 17, p = 7 = 16 and density r = 0.0627. A line in EG(2,2 4 ) 
has 16 points. Puncturing this EG-LDPC code based on a line in EG(2,2 4 ) not passing through 
the origin results in a (239,160) LDPC code with rate R = 0.667, minimum distance at least 17 
and density r = 0.0630. Note that the punctuation removes 15 information bits and one parity 
check bit from the (255,175) EG-LDPC code. Figure 6 shows that the error performance of this 

punctured code is slightly better than that of the original code. 

An EG-LDPC code can be punctured based on the points of a set of q parallel lines with 
1 < Q < 2* — 1. This results in a shortened LDPC code C, of length n = 2 2 * - q • 2' - 1. Its 
parity check matrix H, has 2 2 ' - q - 1 rows and 2 2 ' - q • 2* - 1 columns. Each column of H, 
still has weight 2* but its rows have different weights. 

Example 4: If we puncture the (255,175) EG-LDPC code (given in Example 3) based on the 
points of two parallel lines in EG(2,2<), we obtained a (223,145) LDPC code with rate R = 0.650 
and dmin > 17. The parity-check matrix H, of this code is a 253 x 223 matrix. Thirteen rows 
of H, have weight 16 and all the other rows have weight 14. All the columns of H, have weight 
16. The density of H, is r=0.0632. The puncturing removes 30 information bits and 2 parity 

check bits from the original code. AA 

Puncturing can also be achieved with combination of removing columns and rows of the low 
density parity check matrix H. For example, let Q be a set of l lines in EG(2,2 J ) not passing 
through the origin that intersect at a common point a*, where 1 < / < 2*. Let P be the set 
of lines in EG(2,2') that are parallel to the lines in Q. Suppose we puncture H as follows: (1) 
remove all the rows in H that are the incidence vectors of the lines in Q and P; and (2) remove 
the columns that correspond to the points on the lines in Q. The total number of distinct points 
on the lines in Q is / • (2* - 1) + 1. The total number of lines in Q and P is l ■ (2* - 1). Therefore, 
puncturing results in a (2 2 ' - / • 2* + 1 - 1) x (2 2 ‘ - / • 2* +./ - 2) matrix H,. Both columns 
and rows of H, do not have constant weights any more. The null space of H, gives an irregular 
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LDPC code. 

Example 5: Consider puncturing the (255,175) EG-LDPC code. Let C x and C 7 be two lines 
in EG(2,2*) not passing through the origin that intersect at the point a\ There are 28 lines not 
passing through the origin parallel to either C x or C 2 . Puncturing the parity check matrix H 
of the (255,175) EG-LDPC code based on C x , C 7 and their parallel lines results in a 225 x 224 
matrix H,. Fourteen rows in H, have weight 15 and all the other rows have weight 14. Twenty- 
nine columns of H, have weight 15 and all the other columns have weight 14. The density of H # 

is r = 0.06278. The LDPC code generated by H, is a (224,146) code with minimum distance 
at least 15. 

All the above example shortened EG-LDPC codes have about the same error performance 
as shown in Figure 6. 

PG-LDPC codes can be shortened in a similar way. Consider the two dimensional projective 
geometry PG(2,2') over GF(2*). Let £ be a line in PG(2,2*)- If all the points on C are removed 
from PG(2,2*), we obtain the two dimensional Euclidean geometry EG(2,2') (12,13], This fact 
gives a unique relationship between PG-LDPC codes and EG-LDPC codes. Let C be a PG- 
LDPC code of length 2 2 ' + 2' + 1 with low density parity check matrix H. Recall that H is a 
(2 7 * + 2* + 1) x (2 2 * + 2* + 1) square matrix whose columns correspond to the points in PG(2,2') 
and whose rows are the incidence vectors of the lines in PG(2,2‘). Suppose we delete the columns 
from H that correspond to the points on a line C in PG(2,2'). The column removal results in 
a zero row. Remove this zero row. We obtain a (2 2 * + 2*) x 2 2 ' matrix H 0 . The columns of 
H 0 correspond to the 2 2 ' points in EG(2,2') (including the origin) and the rows H 0 are the 
incidence vectors of all the 2'(2* 4- 1) lines in EG(2,2') (including the lines passing through the 
origin). This matrix Ho is also a low density parity check matrix with p — 2*, 7 = 2* + 1, A = 1 
and r = 1/2'. The null space of H 0 gives a LDPC code C 0 with minimum distance 2' + 2. C 0 
is called a zero-type EG-LDPC code and is not cyclic. 

The first column of H 0 corresponds to the origin a°° of EG(2,2*). Suppose we remove from 
H 0 the first column and the rows which are the incidence vectors of the 2* + 1 lines in EG(2,2') 
that pass through the origin. We obtain a (2 U - 1) x (2 2 ' - 1) square matrix which is the low 
density parity check matrix of the EG-LDPC code of length 2 U - 1 . Therefore we may regard 
that the EG-LDPC codes are descendants of the PG-LDPC codes. For example, the (255,175) 
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EG-LDPC code is a descendant of the (273,191) PG-LDPC code. Note that puncturing 18 
components from the (273,191) PG-LDPC code removes 16 information bits and 2 parity check 
bits from each codeword. 

Clearly, puncturing a PG-LDPC code can be achieved based on a set of lines in PG(2,2'). 

A finite geometry LDPC code C of length n can be extended by splitting each column h 
of its parity check matrix H into q columns with 2 < q < 2 * (for an EG-LDPC code) and 
2 < q < 2 * + 1 (for a PG-LDPC code) which are of the same length as h. Consider the parity 
check matrix H eg of an EG-LDPC code C eg- Dividing 2 * by q , we have 

2 * = 7„iM + l | 

where 0 < b < q. Split each column h* of H EG into q columns h u , h, i2 , ..., h i<9 such that b 
columns, h u , h, i2 , .... h ii(l , have weight 7 tzt + 1 and q - b columns, h.^i, -.hi,,, have weight 
y txt . The distribution of 2* “ones” of h* into h u , h ii2 , ..., h,., is carried out in a rotating manner, 
i.e., the first “ 1 ” of hi is put in h,,i, the second “ 1 ” of hi is put in h l>2 , and so on. This column 
splitting results in a ( 2 7 * - 1 ) x q{ 2 7 ' - 1 ) low density parity check matrix H„ t , £C which has 
the following structural properties: ( 1 ) each row has weight 2 \ ( 2 ) the minimum column weight 
is [2*/q\ (if 2* is divisible by q, each column has weight 2 */q, otherwise there are two different 
column weights, [2*Jq\ and [ 2 */ 9 j + 1 ); (3) any tw0 columns have at most one “ 1 " in common; 
and (4) the density of the matrix is r« t)£C = 2 , /q(2 7t - 1 ). The null space of H „ t)£C gives an 
extended EG-LDPC code C^eg of length n = q(2 7t - 1 ). 

Example 6 : Let s = 5 . There exists a (1023,781) EG-LDPC code (the fourth code given in 
Table 2 ). Suppose we choose 9 = 8 . Then column splitting results in a (8184,7162) extended 
EG-LDPC code of rate R = 0.875 whose parity check matrix has the following parameters: 
p = 32, 7 e *t = 4 , A = 1 and r = 0.0039125. The error performance of this extended code is 
shown in Figure 7 . We see that the extension results in an increase of code rate. AA 

PG-LDPC codes can be extended in the same manner. 

Puncturing and extension give more choices of LDPC codes. In fact, puncturing and column 
splitting can be combined to obtain LDPC code. Proper extension also increase the code rate. 
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5. Generalization 

The construction of LDPC codes based on two-dimensional finite geometries over GF(2*), 

EG(2,2') and PG(2,2‘)), can be generalized to construction based on m-dimensional finite ge- 
ometries over GF(2'), EG(m,2*) and PG(m,2')) with m > 2. 

Consider the m-dimensional Euclidean geometry over GF(2'), EG(m,2'). This geometry 
consists of 2 m * points and 

— 2 ) 

2* - 1 ‘ (5.1) 

lines. Each point in EG(m,2') is represented by an m-tuple over GF(2') and the zero m-tuple 
(0, 0, .... 0) is the origin of the geometry. The Galois field GF(2"") as an extension field of 
GF(2') may be regarded as a representation of EG(m,2‘) [14]. Let a be a primitive element 
of GF(2 m '). Then the 2 mt elements, a 00 = 0,a o ,a,a 2 ,...,a 3 °"- 2 , represent the 2™ points of 
EG(m,2 ) and the element 0 = a 00 represents the origin of the geometry. Each line in EG(m, 2*) 
is a collection of 2* points as defined by (2.1) for the two-dimensional case. For any point p in 
EG(m, 2*), there are 


(2™ - l)/(2* - 1) {5 2) 

lines in EG(m,2') that intersect at p. Let £ be a line in EG(m,2') which does not pass 
through the origin. The incidence vector of C is defined as a (2"“ - lj-tuple over GF(2) 

vc = (*’».'’! **"-*), such that for 0 < i < 2~ - 2, u, = 1 if and only if of is a point in C. 

Therefore the weight of is 2*. 

Let H be a matrix whose rows are the incidence vectors of the lines in EG(m,2*) that do 
not pass through the origin. H consists of 2 m ‘ - 1 columns and 




2 ™ - 1 
2 * - 1 


(5.3) 


rows. The columns correspond to the 2™ - 1 non-origin points of EG(m,2‘). Each row of H 
consists of 2* “ones” and each column of H consists (2™ - l)/(2' - 1) “ones”. The number of 
“ones” in each column of H is simply equal to the number of lines in EG(m,2') that intersect 
at a point in EG(m,2‘). Any two columns of H have exactly one “1” in common. The density 
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of the matrix is 


_ 2* 
f ~ 2 ™ - 1 ‘ 

If m is large, r is very small. Therefore H is a low density matrix. The m-dimensional EG-LDPC 
code of length 2 m * - 1 is simply the null space of H. It is a cyclic and one-step majority-logic 
decodable. Let h be a nonnegative integer less than 2 m * - 1. The generator polynomial g(X) 
of this code has a h as a root if and only if [14] 


0 < max W 2 >(h^) < (m - 1 )( 2 * — 1 ). 

0<l<i ' 


Since (2 m * - l)/(2* - 1) orthogonal check-sums can be formed for majority-logic decoding of 
each code bit, its minimum distance is at least 


2 ™ - 1 
2 ' - 1 


+ 1 . 


(5.4) 


Example 7: Let s = m = 3. The three-dimensional EG-LDPC code constructed based on 
the lines of EG(3,2 5 ) is a (511,139) code with d min = 73 and rate R = 0.272. Its parity check 
matrix H is a 4599 x 511 matrix with p = 8,7 = 72, A = 1 and density r = 0.01565. The error 
performance of this code is shown in Figure 8 . A A 

The above generalization results in a large class of EG-LDPC codes. For m > s, EG-LDPC 
codes in general have rates less than 1 / 2 . 

An m-dimensional EG-LDPC code can also be punctured to obtain a shortened EG-LDPC 
code. Let EG(m - 1,2*) be an (m - l)-flat (or (m - l)-dimensional subspace) of EG(m, 2 *) 
that does not contain the origin. We delete the columns of H that corresponds to the points in 
EG(m - 1 , 2 *). This results in a matrix H' with 2™ - 2 (m-1)4 - 1 columns. The rows in H that 
correspond to the incidence vectors of lines contained in EG(m - 1 , 2 *) becomes zero rows in 
H'. Removing these zero rows in H\ we obtain a low density matrix H, with 2 m4 - 2 (m-1) * - 1 
columns and 

o(m-l)j _ 1 

(2~ - a*—* - 1) 2 ,_ 1 - (5.5) 


rows. Each column of H, still have 7 = (2"** - l)/( 2 * - 1 ) “ones”. But the rows of H, do not 
have uniform weight any more, in fact, there are two different weights, 2* - 1 and 2*. The null 
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space of H, gives a shortened m-dimensional EG-LDPC code. This shortened code is not cyclic 
any more. 

Similarly, we can construct an m-dimensional PG-LDPC code based on the lines of the 
m-dimensional projective geometry over GF(2'), PG(m,2 # ). An m-dimensional LDPC code 
is simply the null space of a matrix H whose rows are the incidence vectors of the lines in 
PG(m, 2*). The columns of H correspond to the (2 (m+1 >' - 1)/(2* - 1) points of PG(m, 2*). H has 
the following parameters: (1) each row has 2* + 1 “ones”; (2) each column has (2 m ' - l)/(2* - 1) 
“ones”; (3) any two columns have exactly one “1” in common; and (4) the density of the matrix 
is (2 ? * - l)/(2< m+1 >' - 1). The m-dimensional PG-LDPC code is cyclic. Let h be a nonnegative 
integer less than 2 (m+ 0* — 1. The generator polynomial of the code has a h as a root if and only 
if h is divisible by 2* - 1 and 


0 - m Wi ‘( h(t) ) - J( 2 * “ *) (5-6) 

with 0 < j < m - 1 [14]. The minimum distance of the code is at least 

(2 rru - l)/(2* - 1) + 1. (5.7) 

Example 8: Let m = s = 3. The 3-dimensional PG-LDPC code is a (585,184) code with 
dmin = 74. A A 

Again for m > s, m-dimensional PG-LDPC codes in general have rates less than 1/2. 
Multidimensional finite geometry LDPC codes can be extended by splitting the columns of 
their parity check matrices. 

Example 9: Consider the three-dimensional (511,139) EG-LDPC code given in Example 7. 
Suppose we extend this code by splitting each column of its parity check matrix H into 24 
columns. Then the extended code C ut ,EG is a (12264,7665) LDPC code with rate R* z tEG = 
0.625. The extension results in a high rate code. The density of the parity check matrix H ezt<£G 
of this extended code is r ez t,EG — 0.000652 and 7 txtjEG — 3- The bit error performance of this 
extended EG-LDPC code with iterative decoding based on belief propagation is shown in Figure 
9, which is only 1.0 dB away from Shannon limit. 

Examples 6 and 9 and Figures 7 and 9 show that column splitting is a powerful method for 
conducting long and high-rate LDPC codes with good error performance. 
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6. Relation to Balanced Incomplete Block Designs 

Analysis and design of experiments is an important subject in combinatorial mathematics. The 
objective of this subject is to design experiments systematically and with a view to their statis- 
tical analysis. One such design is called the balanced incomplete block design[12,13). This type 
of design was used for block code construction in late sixties by some coding theorists [18-22]. 

Let X = {*!, x 2 , . . . ,x„} be a set of n objects. A balanced incomplete block design (BIBD) 
of X is a collection of b p - subsets of X, denoted by B x ,B 2 ,...,B b and called the blocks, such 
that the following conditions are satisfied: 

( 1 ) Each object appears in exactly 7 of the b blocks; 

( 2 ) Every two objects appear simultaneously in exactly A of the b blocks; and 

(3) p < n. 

So, a BIBD is characterized by the five parameters 6 , n, 7 , p and A , it is also called a ( 6 , n, 7 , p, A)- 
configuration. Instead of a list of the p-subsets, a BIBD can also be described by its incidence 
matrix Q, which is a b x n matrix with 0 's and l's as entries. The columns of the matrix 
correspond to the objects and the rows of the matrix correspond to the blocks. The entry in 
the t-th row and j-th column of Q is a 1 if the object Xj is in the block B { and is 0 otherwise. 

The matrix given by Figure 1 is actually the incidence matrix of a BIBD with 6 = n = 15,p = 
7 = 4 and A = 1 . Therefore, the low density parity check matrices constructed in sections 2 and 
3 based on EG( 2 , 2 4 ) and PG(2, 2*) give two special classes of BIBD’s with A =1. From opposite 
point of view, if a BIBD with small p and 7 and A =1, then its incidence matrix can be used as 
the parity check matrix to generate a LDPC code. Over the years, there are many such BIBD’s 
that have been constructed [12,13]. This construction may yield good LDPC codes. This should 
be a direction for further investigation. For example, for any positive integer t such that At + 1 is 
the power of a prime, there exists a BIBD with n = 20t + 5, b = (5£ + l)(4t + l ),7 = 42 + l,p = 5 
and A = 1 . The incidence matrix of this BEBD has density r = 5/(20 1 -I- 5) [12,13]. Is the code 
generated with this matrix as the parity check matrix good? This question should be answered. 
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7 . Decoding of Finite Geometry LDPC Codes and Simulation Results 


Finite geometry LDPC codes and their shortened and extended codes can be decoded with the 
following algorithms: (1) soft-decision iterative decoding based on belief propagation (IDBP) 
[8]; (2) Gallager’s hard-decision bit flipping (BF) iterative algorithm [1,2]; and (3) majority- 
logic decoding [13,14], The soft-decision IDBP algorithm gives the best error performance but 
it requires very large computational complexity and decoding delay. Majority-logic decoding 
requires the least decoding complexity but its error performance is relative poor compared to 
the IDBP algorithm. The BF decoding algorithm provides a very good trade-off between the 
error performance of the soft-decision IDBP algorithm and the decoding complexity of the 
majority-logic decoding. It performs better than the majority-logic decoding and not far from 
the soft-decision IDBP algorithm, which will be shown later by simulation results. 

The IDBP algorithm is well explained in [8] and will not be repeated in this paper. The 
BF algorithm is described in [1,2,24,25], but it is not very well known and not being used for 
decoding LDPC codes. For this reason, we give a brief review of this algorithm. Majority-logic 
decoding can be found in [13,14]. 

Let v = (t> 0 , t»i, ..., v„_i) be a codeword in a low-density parity-check code C. Let hi, hj, ..., h./ 
denote the rows of H matrix. Since C is the null space of H, the inner product v ■ h ; must be 
zero for 1 < j < J, i.e., 


for 1 < j < J. Let 


v • h ; = 0 


(7.1) 


(^b'.Oi •••» l)* (7-2) 

Then from (7.1) and (7.2), we have the following J parity-check equations (or sums): 

n-1 

E v i h U = 0 (7.3) 

»=0 

for 1 < j < J. 

From the second structural property of H, we readily see that every code bit of a codeword 
in C is checked exactly by 7 parity-check equations. Consider the set of 7 parity-check equations 
that check a particular code bit Vj. Since A = 1 , none of the other n-1 code bits are checked 
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by more than one of these 7 parity-check equations. FYom this fact, we see that if there is a 
single error in the received vector r at position », then the 7 parity-check equations that check 
the bit at position i will fail, i.e., 

r • h> = 1 ( 7 . 4 ) 

with hjj = 1 and j € {1,2, • • • , J). If there are two errors in the received vector r, because of 
A « 7, the number of parity check failures will increase, and the number of failed parity-check 
equations that contain either of the two erroneous bits will be greater than [|J, provided that 
the error correcting capability of the code t = [(</„,, n (C) — l )/2 J > 2 . The number of parity- 
check failures increase as the number of errors in r increases until it reaches the error correcting 
capability t of the code. When the number of errors exceeds t , there will be error patterns 
which result in a decrease in the number of parity-check failures. In this case, an erroneous 
bit position may be checked by less than [7/2J failed parity-check equations or by none of the 
failed parity-check equations. Prom the above analysis, we find that if the number of errors in 
the received vector is t or less, changing an erroneous bit results in a decrease in the number 
of parity-check equation failures. However, if the number of errors exceeds the error correcting 
capability t, changing an erroneous bit may result in an increase in the number of parity-check 
failures. 

Based on the above analysis of the parity-check equation failures, Gallager devised the fol- 
lowing decoding scheme for LDPC codes. The decoder computes all the parity-check sums 
based on (7.3) and then changes any bit in the received vector r that is contained in more than 
some fixed number 6 of unsatisfied parity-check equations. Using these new values, the parity 
check sums are recomputed, and the process is repeated until the parity-check equations are all 
satisfied. 

The above decoding is an iterative decoding algorithm. The parameter 6 , called threshold, is 
a design parameter which should be chosen to optimize the error performance while minimizes 
the number of computations of parity-check sums. It is clear that the value of 5 depends on the 
code parameters p,7, A, (C) and the signal-to-noise ratio (SNR). 

If decoding fails for a given value of S t then the value of S should be reduced to allow further 
decoding iterations. For error patterns with number of errors less than or equal to the error 
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correcting capability of the code, the decoding will be completed in one or a few iterations. 
Otherwise, more decoding iterations are needed. Therefore, the number of decoding iterations 
is a random variable and is a function of the channel SNR. A limit maybe set on the number 
of iterations. When this limit is reached, the decoding process is terminated to avoid excessive 
computations. 

Due to the nature of low-density parity checks, the above decoding algorithm corrects many 
error patterns with number of errors exceeding the error correcting capability of the code. 

A very simple BF decoding algorithm is given below: 

Step 1 Compute the parity-check equations. If all the parity-check equations are satisfied, stop. 

Step 2 Find the number of unsatisfied parity-check equations for each bit, denoted /,-,* = 0,1,..., n- 1 . 
Step 3 Identify the set S of bits for which /j is the largest. 

Step 4 Flip the bits in set S. 

Step 5 Repeat steps 1 to 4 until all the parity-check equations are satisfied (for this case, we stop the 
iteration in step 1) or a predefined maximum iteration number is reached. 

The above simple BF decoding algorithm can be improved by using adaptive thresholds <Ts. 
Of course, this improvement is achieved at the expense of more computations. 

Bit and word error probabilities of many finite geometry LDPC codes, their punctured and 
extended codes have been computed based on IDBP, BF and majority-logic decoding algorithms 
as shown in Figures 2-10. From these figures, we first notice that the soft-decision IDBP algo- 
rithm gives the best error performance among the three decoding algorithms at the expense of 
extensive computational complexity. However, Gallager’s hard-decision BF algorithm achieves 
relatively good error performance with much less computational complexity. It outperforms 
the simple majority-logic decoding. Therefore, it provides a good trade-off between the error 
performance of the IDBP algorithm and the complexity of majority-logic decoding algorithm. 
Next we notice from Figures 2, 3 and 4 that PG-LDPC codes and their descendant EG-LDPC 
codes have (almost) identical error performance. Figure 6 shows that the (255,175) EG-LDPC 
code and its punctured codes have almost the same error performance. Figure 7 shows that 
the (8184,7162) LDPC code obtained by extending the (1023,781) EG-LDPC code with column 
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splitting achieves an error performance within 0.9 dB from Shannon limit. Figures 9 gives the 
error performance of the (12264,7665) LDPC code obtained from the 3-dimensional (511,139) 
by column splitting. We see that its error performance is about 1 dB away from Shannon limit. 
Figures 7 and 9 suggest that proper column splitting of finite geometry codes may result in very 
good LDPC codes. 

Figures 2 and 3 also give a comparison of the error performance of the finite geometry LDPC 
codes of lengths 255 (or 273) and 1023 (or 1057) to that of some best computer generated 
Gallager LDPC codes of the same lengths and same rates. We see that these finite geometry 
codes outperform their corresponding computer generated Gallager LDPC codes. However, for 
large code lengths, the best computer generated LDPC codes should perform better than the 
finite geometry codes because they are chosen from larger code ensembles. Finally Figure 10 
shows how fast the (4161,3431) PG-LDPC code converges to its ultimate error performance 
using 1DBP algorithm. We see that 20 iterations are enough to terminate the decoding iteration 
process for this code. For all the finite geometry codes that we have simulated, the 1DBP 
algorithm converges very fast. 

8 . Conclusion 

In this paper, we have reported two classes of LDPC codes that are constructed based on 
the lines of two-dimensional Euclidean and projective geometries. These finite geometry codes 
can be decoded with soft-decision IDBP algorithm, Gallager’s BF algorithm and majority-logic 
decoding. Simulation results show that they perform very well and close to their Shannon 
limits with the IDBP algorithm. These codes also perform well with Gallager’s BF algorithm. 
The BF algorithm provides a good trade-off between the good error performance of the IDBP 
algorithm and the simple complexity of majority-logic decoding. Furthermore, they are cyclic 
and hence can be easily encoded with feedback shift registers in contrast to the complex encoding 
of computer generated LDPC codes. We have also shown that these finite geometry codes can 
be punctured and extended to obtain good LDPC codes. Proper extension by column splitting 
results in good high rate codes. 

We have also extended the two-dimensional finite geometry LDPC codes to multidimensional 
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finite geometry codes. This extension gives a large class of LDPC codes with various rates. A 
close relationship between a low density parity check matrix and a balanced incomplete block 
design has also been presented. This relationship may allow us to construct LDPC codes based 
on many existing balanced incomplete designs. 

The results presented in this paper show that algebraic or geometric construction of LDPC 
codes are possible and the constructed codes are good. Therefore, further investigation is needed 
and we should give algebraic construction a chance as Tanner suggested [ 23 ]. 
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List of figure captions 


Figure 1. A low density parity check matrix. 

Figure 2. Bit-error probabilities of the (255, 175) EG-LDPC code (maximum 50 iterations), (273,191) 
PG-LDPC code(maximum 50 iterations) and two (273,191) Gallager codes generated by 
computer (maximum 200 iterations) based on IDBP algorithm. 

Figure 3. Bit- and word-error probabilities of the (1023,781) EG-LDPC code, the(1057,813) PG- 
LDPC code and two (1057,813) Gallager codes generated by computer . 

Figure 4 . Bit- and word-error probabilities of the (4095,3367) EG-LDPC code and the(4 161, 3431) 
PG-LDPC code. 

Figure 5. Bit- and word-error probabilities of the (16383,14179) EG-LDPC code. 

Figure 6. Bit-error probabilities of the (255,175) EG-LDPC code and its (239,160), (223,145) and 
(224,146) punctured codes. 

Figure 7 . Bit- and word-error probabilities of the (8184,7162) LDPC code obtained by extending 
the (1023,781) EG-LDPC code using column splitting with q= 8. 

Figure 8. Bit- and word-error probabilities of the (511,139) EG-LDPC code. 

Figure 9. Bit- and word-error probabilities of the (12264,7665) LDPC code obatined by extending 
the (511,139) EG-LDPC code by usuing column splitting with g=8. 

Figure 10. Convergence of the IDBP algorithm for the (4161,3431) PG-LDPC code. 


24 


Table 1: The elements of GF(2 < ) generated by p(X) = 
l + X + X* 


Power 

representation 



Polynomial 

representation 


4-T\jple 

representation 

0 

0 







(0 0 0 0) 

1 

1 







(1 0 0 0) 

a 



a 





(0 10 0) 

a 2 





a 2 



(0 0 10) 

a 3 







a 3 

(0 0 0 1) 

a 4 

1 

+ 

a 





(110 0) 

a 5 



a 

+ 

a 2 



(0 110) 

a 6 





a 2 

+ 

a 3 

(0 0 1 1) 

a 7 

1 

+ 

a 



+ 

a 3 

(110 1) 

a 8 

1 



+ 

a 2 



(10 10) 

a 9 



a 



+ 

a 3 

(0 10 1) 

a 10 

1 

+ 

a 

+ 

a 2 



(1110) 

a 11 



a 

+ 

a 2 

+ 

a 3 

(0 111) 

a 12 

1 

+ 

a 

+ 

a 2 

+ 

a 3 

(1111) 

a 13 

1 



+ 

a 2 

+ 

a 3 

(10 11) 

a 14 

1 





+ 

a 3 

(10 0 1) 


Table 2: List of EG-LDPC codes 


n 

k 

d~min 

P 

7 

r 

15 

7 

5 

4 

4 

0.267 

63 

37 

9 

8 

8 

0.127 

255 

175 

17 

16 

16 

0.0627 

1023 

781 

33 

32 

32 

0.0313 

4095 

3367 

65 

64 

64 

0.01563 

16383 

14197 

129 

128 

128 

0.007813 
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Table 3: List of PG-LDPC codes 


n 

k 

^TTUfl 

P 

7 

r 

21 

11 

6 

5 

5 

0.2381 

73 

45 

10 

9 

9 

0.1233 

273 

191 

18 

17 

17 

0.0623 

1057 

813 

34 

33 

33 

0.0312 

4161 

3431 

66 

65 

65 

0.0156 

16513 

14326 

130 

129 

129 

0.0078 


H = 


00 0 0 0 00 1 1 0 1 000 1 
1 00 00 000 1 1 0 1 000 
0100000001 10100 
001000000011010 
000 1 0 00 0 000 1 1 0 1 
100010000000110 
0 1 00 0 1 0 0 00000 1 1 
1 0 1 000 1 0 000000 1 
1 10100010000000 
0 1 1 0 1 00 0 1 000000 
001 101000100000 
0001 10100010000 
0 000 1 1 0 1 000 1 000 
000 00 1 1 0 1 000 1 00 
0000001 10100010 


Figure 1: A low density parity check matrix. 
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Figure 2: Bit-error probabilities of the (255, 175) EG-LDPCcode (max- 
imum 50 iterations), (273,191) PG-LDPC code(maximum 50 iterations) 
and two (273,191) Gallager codes generated by computer (maximum 
200 iterations) based on IDBP algorithm. 



Figure 3: Bit- and word-error probabilities of the (1023,781) EG-LDPC 
code, the(1057,813) PG-LDPC code and two (1057,813) Gallager codes 
generated by computer . 
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Figure 4: Bit- and word-error probabilities of the (4095,3367) EG 
LDPC code and the(4161 ,3431) PG-LDPC code. 
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Figure 5: Bit- and word-error probabilities of the (16383,14179) EG 
LDPC code. 
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Figure 6: Bit-error probabilities of the (255,175) EG-LDPC code and 
its (239,160), (223,145) and (224,146) punctured codes. 



Figure 7: Bit- and word-error probabilities of the (8184,7162) LDPC 
code obtained by extending the (1023,781) EG-LDPC code using col- 
umn splitting with ^=8. 




Figure 8: Bit- and word-error probabilities of the (511,139) EG-LDPC 
code. 



Figure 9: Bit- and word-error probabilities of the (12264,7665) LDPC 
code obatined by extending the (511,139) EG-LDPC code by usuing 
column splitting with q=S. 
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Figure 10: Convergence of the IDBP 
PG-LDPC code. 
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algorithm for the (4161,3431) 
















